A BIDETERMINANT BASIS FOR A REDUCTIVE MONOID 



RUDOLF TANGE 



Summary. We use the rational tableaux introduced by Stembridge to give 
a bideterminant basis for a normal reductive monoid and for its variety of 
noninvertible elements. We also obtain a bideterminant basis for the full 
coordinate ring of the general linear group and for all its truncations with 
respect to saturated sets. Finally, we deduce an alternative proof of the 
double centraliser theorem for the rational Schur algebra and the walled 
Brauer algebra over an arbitrary infinite base field which was first obtained 
by Dipper, Doty and StoU. 



Introduction 

Let k be an infinite field. Assume for the moment that k = C Amongst the 
several instances of Schur- Weyl duahty there are: 

• The symmetric group Sym,^ and the general linear group GL^ acting on V^^, 
V = k'^ the natural module of GL„. 

• The Brauer algebra B^{n) or Br{—n) and the orthogonal or symplectic group 
acting on V^^', V = k^ the natural module of the orthogonal or symplectic 
group. 

• The walled Brauer algebra Br^sinT-), see [T] or [7], and the general linear group 
GL^ acting on V^'' (g) (y*)®'^', V = k"' the natural module of GL„. 

The initial motivation of this paper was the third instance of Schur- Weyl duality 
for k any infinite field. The way to understand this duality is to consider the 
action of the orthogonal group 0^ ^ GL^ as well. For the orthogonal group we 
have V = V* . So, by the second instance, we should have that the centraliser 
algebra is a subalgebra of the Brauer algebra Bj.+s{^)- The problem is to 
show that the image of the walled Brauer algebra and the enveloping algebra 
of Ghm in Endfc(y®'' <^ (y*)®*) are each other's centraliser. The hard part 
here is to show that the centraliser algebra of the walled Brauer algebra is the 
enveloping algebra of GL^- This led us to study a certain reductive submonoid 
M of Matm X Matm which is the main topic of this paper. In fact we have to 
study M as a monoid scheme and then deduce afterwards that it is reduced 
over k. To do this we will apply modified versions of the methods of [22] and 
[31| . We will state results in a form which makes the link with the general 
theory of reductive groups clear. This is made possible by an improved result 
about straightening in To make the exposition as clear as possible we first 
consider bideterminant bases for the variety of n x n-matrices Mat„ and for the 
symplectic group Sp2m- Onv method is to move in the sequence Mat„, Sp2m^ ^ 
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things as much as possible in the Mat„-direction and to give for the other cases 
only proofs if they differ significantly from the previous case. 

The paper is organised as follows. In Section [1] we state the results on bide- 
terminants and straightening from |9j and mention the link with the general 
theory of reductive groups. Furthermore we give a result which relates envelop- 
ing algebra of a sub monoid of Matm x Matm in Endfc(F®'' V^^) with its 
vanishing ideal. In Section [5] we give the basic results about bideterminants 
and straightening in the symplectic case. This is based on Oehms' work |31] . 
Since we want to explain the link with the general theory of reductive groups, 
we have to do the straightening directly in A;[SpM^] and not in A;[SpM„]/((i) as 
in |31) . The point is that we have to know something about the shapes of bide- 
terminants of lower degree that show up during straightening. In Section [3] we 
finally give the results about bideterminants and straightening for the monoid 
M. To construct our bideterminant basis we need rational tableaux as intro- 
duced by Stembridge [35]. We also show that the full coordinate ring of GL^ 
has a bideterminant basis and we show that M is normal and therefore, by a 
result of Rittatore, Cohen-Macaulay. In Section [J] we give a proof of the double 
centraliser theorem for GL^ and the walled Brauer algebra Br^sifn) acting on 

1. Preliminaries 

Throughout this paper k denotes an infinite field and K denotes the algebraic 
closure of k. We will denote a scheme over a commutative ring R always like Xji, 
the base ring as a subscript. All schemes in this paper are affine and algebraic 
over the base ring. We refer the reader to [25] or |12j for the basics about 
schemes. We will only make a very modest use of these. If ^4 is a commutative 
-R-algebra, then we write ^(^4) = Xfi,{A) for the points of over A. In case R 
is Z or our infinite field k we will, to keep notation manageable, simply denote 
X{k) by X. We denote the coordinate ring of Xji by it can be identified 

with the -R-algebra of morphisms Xji A^, where A)j denotes the affine line 
over R. There is a canonical homomorphism of -R-algebras from R[Xfi] to the 
algebra of i?-valued functions on X{R); we denote its image by R[X{R)]. If 
the base ring is Z or k, then the epimorphism /c[Xfc] — t- k[X] is an isomorphism 
if and only if Xk is reduced and X(k) is dense in X{K). To avoid artificial 
generality, we will work over Z if we want results valid for more general rings 
than fields. The reader can obtain the result he is interested in by tensoring 
with his favourite ring (e.g. C). 

Now let n be an integer > 1, let Mat„^a be the Z-scheme of n x n-matrices and 
let Ghn^z be the Z-group scheme of n x n-matrices. So, for a commutative ring 
A, Matn{A) is the set of n x n matrices over A and Gljn{A) is the group of in- 
vertible nxn matrices over A. We have Z[Mat2] = Z[(xjj)jj], the polynomial al- 
gebra over Z in the matrix entries Xij. Furthermore, li[GLz] = Z[Matz] [det^"*^]. 
The group scheme GLn^z x GL^^z acts on Matn,z via {g, h) ■ A = gAh~^ for 
g,h & GL„(i?), A € Matn(-R) and R a commutative ring. We obtain an action 
on the coordinate ring of Mat„^z which is given by {{g, h) ■ fR){A) = f]i{g~^Ah) 
for / E Z[Matz], g,h € GL„(i?), A E Matri(-R) and R a commutative ring. The 
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action of the left resp. right factor of Ghn,z x Ghn,z on Z[Matn,z] comes from 
the left resp. right multiplication and therefore we refer to it as the left resp. 
right regular action. We note here that for R any commutative ring i?[GLK] 
is flat over R, since i?[Mat„,_R] is free over R and localisation is exact. As a 
consequence the category of GL„ ^-modules is abelian, see 1.2.9]. In fact 
one can show with a bit more effort that i?[GL„^R] is free over R. In Section [3] 
we will see an explicit basis. 

We denote the character group (the homomorphisms to GLi^^) of the maxi- 
mal torus of Ghn^z of diagonal matrices by X. We have X = where the z*^ 
diagonal matrix entry corresponds to the i^^ standard basis element Si of Z". 
We denote the set of dominant (relative to the Borel subgroup of upper triangu- 
lar matrices) weights Ai > A2 > • • • > A„ by X'^ and the set of the polynomial 
dominant weights, i.e. partitions of length < n, Ai > A2 > • • • > A„ > 0, 
by A+(n). Put n := {!,..., n}. For \ £ X we put |A| = J27=i^i- 
A is a partition we say that A is a partition of r if |A| = r. Furthermore, 
|{« € n I Aj / 0}| is called the length of A. For X, fi £ X we write /i < A if A — /it 
is a sum of positive roots, i.e. if |A| = and Ylj^i fJ-i < "^1=1 \ for all j G n. 
For partitions this is the well-known dominance order. Now let A be a partition 
of length / < n. Then the shape or Young diagram of A is the set of pairs {i,j), 
where 1 < j < Aj and 1 < i < I. The conjugate partition of A is the partition 
whose diagram is the transpose of that of A. We denote it by A'. Note that the 
length of A' is Ai, the number of columns of A. 

We assume given a linear order < on n, for example the natural order. A 
tableau of shape A is a function from the shape of A to n and a bitableau of 
shape A is a pair {S,T) where S and T are tableaux of shape A. A tableau is 
called standard if, according to ^, its entries are strictly increasing down the 
columns and weakly increasing in the rows from left to right. Note that for two 
linear orderings ^1 and ^2 of n there is a permutation of n which induces a 
bijection between the tableaux that are standard relative to ^1 and those that 
are standard relative to ^2- For a partition A of length I < n we define the 
canonical tableau of shape A, Tx, to be the tableau of shape A whose entries in 
the i^^ row are all equal to z, 1 < i < /. Now let {S,T) be a bitableau of shape 
A. Then the product of the minors 

det {ixs{r,i)T{s,i))l<r,s<Xr ), (1) 

I < i < Ai, in Z[Mat„^z] is called the bideterminant associated to {S,T) and we 
denote it by {S \ T). So, as in {24], we form bideterminants according to pairs of 
columns in a bitableau rather than to pairs of rows as in [9J. Put differently, the 
bideterminant associated to {S, T) in [9] is the bideterminant that we associate 
to (S",T'), where S' and T' are the transposed tableaux of S and T (they 
have shape A'). The reader should note that the bideterminants associated to 
bitableaux of shape r£\ for some r > are precisely the monomials in the Xij. 
We define the content or weight of a tableau T to be X^eT(ij)! where we sum 
over the (i,j) in the shape of A. So the i^^ component of the content of T is 
the number of times that i occurs in T. If T is a tableau of shape A and weight 

II with no repeated entries in the columns, then it is elementary to check that 



4 



R. H. TANGE 



A'^'^^ < /i < A, where A''*'^ denotes the reversed tuple of A. We define the weight 
of a bitableau {S, T) to be (— /i, u) & X x X, where ^ is the weight of S and v 
is the weight of T. If Hz is the maximal torus of diagonal matrices of GL„_Z; 
then the bideterminant (S \ T) is an x weight vector with weight equal 
to that of {S,T). The degree of a tableau or bitableau of shape A is defined 
to be |A|. Note that the degree of a tableau is also determined by its content 
and that the degree of a bideterminant {S \ T) is equal to that of the bitableau 
{S,T). 

For a partition A of length < n we define A<^x and to be the Z-span 
of the bideterminants {S \ T) with S and T tableaux of shape < A resp. < A. 
Furthermore we define and Vz(A) as the Z-span of the bideterminants 

{T\ I S) resp. [S \ T\) with S a tableau of shape A. Note that A<\ and 
are Ghn,i x GL^^^-submodules of Z[Mat„^z] and that Vz(A) and Vz(A) are 
submodules for the right resp. left regular action. Note also that the notion of 
standardness is not involved in the above definitions. 

We now state a result from [9J. The reader should hear in mind that the 
transpose is (dominance) order reversing on partitions of the same number (see 
e.g. [251 l-ll])- Assertion (i) below is due to Hesselink and Stein independently. 
It is an improved version of the first version of the straightening algorithm that 
can be found in [2T] and [22]. The point is that one can show that the new 
shapes that show up during straightening are all < the original shape in the 
dominance order. As a consequence the combinatorial results on straighten- 
ing match up nicely with the general theory of reductive groups. Of course, 
statements like (iv) below are known to hold for the coordinate rings of ar- 
bitrary reductive groups (see [25^ II.4.20]), but the main point here is that 
these filtration subspaces and induced modules can be realised explicitly using 
bideterminants . 

Theorem 1.1 ([9", Sect. 1-3]). Let X be a partition of length < n. Recall that 
the type An-i partial order on weights (dominance order) is denoted by <. 

(i) Let S and T be tableaux of shape A. Then the bideterminant {S \ T) can 
be written as a linear combination ai{Si | Tj), where the ai are integers 
and the Si and Ti are standard of shape < A with the same content as S 
and T respectively. 

(ii) The bideterminants {S \ T) with S andT standard form a basis o/Z[Mat„_z] 

(iii) The elements {T\ \ T), T standard of shape A form a basis of Vz(A) and 
the elements (r|r\), T standard of shape A form a basis ofVz{X). 

(iv) The map {S \ Tx) (8) (Tx \ T) (S \ T) defines an isomorphism 

Vz(A) (»z Vz(A) ^ A<x/A<x 

of GLn^z X GLn^z-iTT'Odules. 

We recall some definitions from \T5\ (see also [16] ) . A subset vr of X~^ is called 
saturated if ;U G X^ and /x < A G vr implies ^ G vr. Now let tt be a saturated 
subset of X^ and let i? be a principal ideal domain. For any torsion-free GL„^/j 
module (i.e. right i?[GLn^/j]-comodule) M the submodule O-jriM) is defined to 
be the sum (or the union) of the submodules of M which are finitely generated 
(and therefore free of finite rank) over R and whose dominant weights relative 
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to the maximal torus of diagonal matrices lie in tt. Clearly, Ot^{M) is the 
sum of the 07r'(M), vr' C vr finite, and M/Ot^IM) is torsion- free. Furthermore, 
0.^{F (8)R M) n M = 0^{M), where F denotes the field of fractions of R. 
When we write 07r(i?[Mat„^R]) or 07r(-R[GL„.ij]), then we consider R[Matn,R] 
or i?[GL„^^] as a GL„^^-module under the right regular action. The resulting 
module is stable under the GLn^R x GL„^/j-action. 

Let Bz and be the Borel subgroups of upper resp. lower triangular matri- 
ces in Ghn^z, let i? be a commutative ring and let X £ X. By applying A to the 
diagonal part of a upper or lower triangular matrix we obtain a 1-dimensional 
representation of Bz or B^ which we also will denote by A. Now let be Bz 

GL 

or B^. Then ind^^^"'^ (A) is defined to be the set of / G i?[GLn^R] such that 
f{hg) = X{h)f{g) for all h G H{A) and g G GL„(A) and A any commutative R- 
algebra. This is a submodule of i?[GL„^/j] for the right regular action. In [25] the 
induced module associated to A is defined by the property f{gh) = X{h)~^f{g). 
This is a submodule for the left regular action. The automorphism of -R[GLfj /j] 
given by the inversion maps one induced module onto the other and induces an 
isomorphism of GL^^/j-modules. We have ind^^"'^(A) = i? (g)^ ind^^"'^(A), see 

\25\ 11.8.8(1)]. Furthermore, ind^^"'^(A) = ind^'^"'^(A'''^^), where the isomor- 

phism is given by left multiplication with the matrix of the permutation of n 
that sends i to re -|- 1 — i. Finally, we point out that the above definitions and 
facts about Ot^ and the induced modules apply, with appropriate modifications, 
to any split reductive group scheme over Z. 

Corollary. 

(i) Let X G A+(re). Then Vz(A) = ind^^"'^(A) and Vz(A) is the induced 



module of the B^-module —A, according to |25j . 

(ii) Let TT C A+(re) be saturated. Then 07r(Z[Mat„_z]) = 07r(^[GL„_z]) is 
spanned by the bideterminants {S \ T) where S and T have shape G vr. 
Moreover, the {S \ T) with S and T standard of shape G vr form a basis. 

Proof, (i). Over a field this is of course standard, see e.g. |24t 4.8]. We give 
a brief proof using the theory of reductive groups. One easily checks that 
Vz(A) C ind "'^(A) and that Vz(A) is contained in the induced module of the 

GL 

Bz-module —A, according to [25j, which is isomorphic to ind "'^(A*), where 

z 

A* = — A'''^^. Now Vq(A) and Vq{X) have dimension equal to the number of 
standard tableaux of shape A which is well known to be the dimension of the 
irreducible GL„,(C)-module of highest weight A and of course also that of its 
dual which has highest weight A*. The formal characters of these modules 
are given by Weyl's character formulas for A and A*. The formal character of 

GL 

ind is given by Weyl's character formula for /x, see [251 Cor. II. 5. 11]. So 

GL ~ 

Vq(A) = ind "'"^(A) and similarly for V(q(A). Now the assertion follows from 

the fact that Z[Mat„,z]/Vz(A) and Z[Matn,i]/Vz{X) are torsion-free (if ^ is 
the natural order, then T\ is standard). 
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(ii). We may assume that vr is finite. Let be the Z-span of the bidetermi- 
nants {S \ T) where S and T have shape € vr. Clearly Q 07r(Z[Mat„^z]) C 
Ovr(Z[GL„^z]). Furthermore, Q^z^tt and 07r(Q[GL„^(g)]) have the same dimen- 
sion by 3.2] and the remarks above. So the assertion now follows from the 
fact that Z[Ma,tn,z]/A-x and 07r(Z[GL„^z])/Z[Mat„^z] are torsion-free. □ 

Remarks 1.1. 1. Theorem 11.11 in [9] was only proved for ^ the natural or- 
dering. But one can in fact deduce from it a version for two different linear 
orderings and ^2 requiring in a bitableau {S,T), S to be standard relative 
to ^1 and T to be standard relative to ^2- One simply has to apply the auto- 
morphism of the Z- module Z[Mat„^z] induced by the automorphism A 1— )• PAQ 
of the scheme Mat„_z for suitable permutation matrices P and Q. To obtain 
Theorem ILlf i) and (ii) we take P = and to obtain assertion (iii) we first 
take P = I, the identity matrix, and then Q = I. 

1. If one works with nonsquare n x m-matrices as in [9], then, in a bitableau 
{S, T), S should have entries in {1, . . . , n} and T should have entries in {1, ... , m} 
Furthermore, one has to work with A+(min(n, m)): partitions of length < 
min(n, m). 

2. Let Ai, A2, A3, . . . be an enumeration of the partitions of length < n such that 
Xi < Xj implies i < j. Put Bi = Ovr, (Z[Mat„^z]), where vTj = {Xj \1 < j < i}, a 
saturated set. Then {Bi)i>Q is a GLn^z x GL„^z-niodule filtration of Z[Matn,z] 
with Bi/B,^i ^ Vz(A,) ®z Vz(A,) for i > 1. 

We remind the reader of our convention to denote Matn(A;) by Mat„. Clearly, 
the canonical epimorphism A;[(Mat„)fc] — > A;[Mat„] is an isomorphism. The same 
remarks apply to GL„. In the next sections we will need some results relating 
graded pieces of the coordinate ring of a submonoid of Mat„ or Matj x Matm 
and the enveloping algebra of that monoid in a certain module. The result for 
submonoids of Mat„ is \37\ Prop. 1] and its corollary. We now give the analogue 
for submonoids of Mat; x Matm- 

Let l,m be positive integers. Put V = and W = /c™. Any {u,v) G 
Mat/ x Matm determines an endomorphism of V^^ (8) W^'^ by 

{u,v){xi (8) • • • (8) Xr (8) j/i (8) • • • (8> ys) = u{xi) (8 • • • (8 u{xr) (8 v{yi) • • • (8 v{ys). 

For a subset S of Mat/ x Matm we denote by £^'^{S) the enveloping algebra 
of S in Endk{V^^ (8 W^^), that is, the subalgebra generated by the endo- 
morphisms of V'^''' (8 W^^ corresponding to the elements of S. Using the iso- 
morphism EndkiV^'' (8 IV®*) = Endfc(F®'^) (8 Endfe(iy®*) we have £'''''{3) = 
€"^'^{8) 'S'S^'^{S), where £^'^{S) and S^'^{S) are the enveloping algebras of S in 
Endfc(y®^) and Endfc(W®*) respectively. 

The algebra A: [Mat/ x Matm] = A; [Mat/] (8 A; [Mat m] is Z X Z-graded. A subspace 
is homogeneous with respect to this grading if and only if it is stable under the 
action ofk^ xk^ on A;[Mat/xMatm] which comes from the action on Mat/ x Matm 
given by (a, 6) • {A,B) = (aA,bB). For any Z x Z-graded vector space U over 
k we denote the graded piece of degree (r, s) by For S C Mat/ x Matm 

we denote by k[S] the /c-algebra of A;- valued functions on S that are restrictions 
of functions in A; [Mat/ x Matm]- Clearly this notation conflicts with our earlier 
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notation, e.g. in the case S = GL; x GLm, so later on we will only use this 
notation in a situation where there is no conflict. 

The next proposition and its corollary are a version of [371 Prop. 1] and its 
corollary. The proofs are a straightforward modification of the proofs in |37j . 
For assertion (ii) has to use the fact that for groups Gi and G2,Ui a A;Gi-module 
and U2 a fcG2-module, we have for the invariants: (t/i(8>[/2)'^^^'^^ = U^^ 'S)U2^. 
The natural map from assertion (i) is given by precomposing with the natural 
homomorphism M — )• (M) of monoids. 

Proposition 1.1. Let M be a submonoid o/Mat; x Matm with {k^ x k'' )M = 
M. Then 

(i) the natural map £^'^{M)* — )• fc[M]'''* is an isomorphism of coalgebras, 

(ii) £-^^{GU X GL„) = Endfc^Sym.xSym.>(^^'' ® W^^) . 

Corollary. Let M he a submonoid 0/ Mat/ x Matm with {k^ x k^)M = M, 
let I be the (homogeneous) ideal of polynomial functions on Mat; x Matm that 
vanish on M. Furthermore, let gi, . . . , gt be nonzero homogeneous elements of 
L. Denote the isomorphism A;[Mat; x Matm]'"''^ £'^'^{M&ti x Mat^)* by rj. 
Then the elements gi, . . . ,gt are generators of L if and only if for each r,s > 0, 
(r, s) 7^ (0,0), the functionals rj{gimi), where the rrii are arbitrary monomials 
in the matrix entries of degree {r,s) — deg{gi), define the algebra £'^'^{M). 

2. Symplectic straightening 
From now on we assume that n = 2m, m > 1, is even. We take 



J 



Jm 

-Jm. 



or J 



/ 
-I 



(2) 



where Jm is the mxm matrix with ones on the antidiagonal and zeros elsewhere, 
and I is the mxm identity matrix. Everything in this section will be valid for 
both choices of J. For every integer i € n there is a unique integer i' ^ n and 
a unique nonzero scalar ej € such that Jj^j' = e^. Clearly i" = i and we have 
€i = 1 if i < m and = — 1 if i > m. 

Let Vz = be the natural module of the monoid scheme Mat„^z and denote 
the standard basis elements by ui, . . . , u„. On we define the nondegenerate 
symplectic form ( , ) by 

n 

(x, y) := x^Jy = ^ eiXiyi> . 

i=l 

Let -R be a commutative ring. The symplectic group Sp„(i?) over R consists of 
the n X n-matrices A over R that satisfy A^JA = J, i.e. the matrices for which 
the corresponding automorphism of V preserves the form ( , ) . The symplectic 
monoid SpM„(i?) over R is defined as the set of n x n-matrices A over R for 
which there exists a scalar d{A) G R such that A^JA = AJA^ = d{A)J. 
The group of invertible elements of SpM„(i?) is the symplectic similitude group 
GSp„(i?) over R. It consists of the matrices A that satisfy A^JA = d{A)J 
for some invertible scalar d{A) € R, i.e. the invertible matrices for which the 
corresponding automorphism of V preserves the form ( , ) up to a scalar. We 
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denote the functors R i-> Sp„(ii), R SpM„(i?) and R i->- GSp„(i?) by Sp^ ^i 
SpM„ 2 ^-^d GSp„ 2- The functors Sp„^g and SpM^^^ are closed subschemes of 
Matn,z and the functor GSp^ g is a closed subscheme of GLn^z- For i,j € n, 
define G Z[Mat„,z] by 

n n 

9ij ■='^(^ixiixi'j and g^j := ^^eixuxji' . (3) 

Note that gu = 5jj = and that gij = —gji and = —'gji- The ideal of Sp^^^ 
in Z[Matn,z] is generated by the elements gij, 1 < i < j < n, i j', and g^r' — 1) 
1 < r < m. The ideal of GSp^^ in Z[GLn,i] is generated by the elements gij, 
^^i<jl^n, iy^j', and grr' — gss', 1 < r, s < m. The ideal of SpM„^ in 
Z[Mat„_z] is generated by the elements 

{gij, 9ij, 9rr' - 9ss' \ ^ <i < j <n,i ^ <r,s <m}. (4) 

Using \12\ Thm. II. 5. 2.1] or [SSJ 12.2], a simple Lie algebra computation shows 
that the fibers of Sp„ ^ and GSp„ ^ over Spec(Z) are reduced. This means 
that for F a prime field (including Q) the algebras F[Sp^^] and F[GSp„p'] 
are reduced. Since these fields are perfect this holds for any field (as one could 
have showed directly by the same method). So i^[Sp„^] and ii'[GSp„^] are 
the coordinate rings of the connected reductive algebraic groups Sp^(iC) and 
GSp„(i^), see [3]- Furthermore it is clear that they are defined over the prime 
field as closed subgroups of GL„(K). The derived group of GSp„(i<') is Sp^ {K). 
Clearly GSp„ = GSp„(A;) is the group of fc-points of GSp„(K) and therefore 
it is dense in GSp„(K) by [3] Cor. V.18.3]. Put d = giy . The restriction of 
d to SpM„ 2 is called the coefficient of dilation. It is equal to the function d 
mentioned above. We have = det^ in Z[SpM„^2] (after Theorem 12.11 one can 
show that d^ = det). Note that ZfGSp^^] = ^[SpM„ 2][d~-^]. Of course there 
is, just as in the GL„^z-case, an action of Sp„_2 x Sp„_2 on ^[SpM^^^], Z[GSp„_g] 
and Z[Sp„^z]. 

We denote the character group of the maximal torus of SpM„ ^ of diagonal 
matrices by X. We have X = Z"* and we denote the standard basis elements by 
Ej. We embed Z"^ in Z" by extending m-tuples with m zeros. The restriction 
of a character of the diagonal matrices in GLn,z to those in Sp„ ^ is given by 
the map A i— )• A : Z™ with ej = Si for i < m and £i = —Si for i > m. In 

the root system of type Cm we choose the set of positive roots as usual, they 
are: £i — Sj, 1 < i < j < m, £i + Sj, i,j £ m with i ^ j and 2ej, i G m. If J 
equals the first matrix in ^ , then the corresponding Borel subgroup of Sp„ ^ 
is the subgroup of upper triangular matrices. If J equals the second matrix in 
([2]), then the corresponding Borel subgroup of Sp„ ^ is the subgroup of matrices 



of the form 



A B 
C 



with A upper triangular and C lower triangular. The set 

of dominant weights is X~^ = A"'"(m), the partitions of length < m. We denote 
the type Cm partial order on Z™ by <. We have /x < A if and only if |A| — |//| 
is even > and ^11=1 l^i — l^i=i all j G m. 



A BIDETERMINANT BASIS FOR A REDUCTIVE MONOID 



9 



We assume given a linear order ^ on n such that for all i m, i is the 
immediate successor of i' or the other way around, for example 1' ^ 1 -< 2' ^ 
2 ■ ■ ■ ~< m' ^ m. Define (" : n — )• m by |{z € n | i ^ j or i ^ j'}\ = 2({j) for all 
j G n. Note that i ^ j implies < and that <^{i) = if and only if 
i = j or j' . A subset / of n is called symplectic standard if 



for all j G m. Taking j m such that either j or j' is the maximal element 
of I according to ^, we see that |/| < m whenever / is symplectic standard. 
We identify each subset 7 of n with the one column tableau whose entries 
are the elements of / and whose entries are strictly increasing (according to 
:<) from top to bottom. A tableau is called symplectic standard if it is GL„- 
standard (relative to ^) and if the first column is symplectic standard as a set. 
So the shape of a symplectic standard tableau has length < m. If a tableau 
is symplectic standard, then all its columns are symplectic standard. So a 
GL„-standard tableau is symplectic standard if and only if for all i G m the 
occurrences of i and i' are limited to the first C(^) rows. Note that for two 
linear orderings and ^2 of n as above there is a permutation of n which 
stabilises G rn} and induces a bijection between the tableaux that 

are symplectic standard relative to ^1 and those that are symplectic standard 
relative to ^2- A bitableau {S,T) is called symplectic standard if S and T 
are symplectic standard. We denote the restriction of a bideterminant {S \ T) 
to SpMjj^2 by the same symbol. The symplectic weight of a tableau with GL„ 
weight n is defined as the restriction Jl. If T is a tableau with shape A of length 
< m, with symplectic weight /i and with no repeated entries in the columns, 
then it is easy to check that —X<fj,<X. The symplectic weight of a bitableau 
is also defined by restriction of its GL„ weight. 

Let /\Vzhe the exterior algebra on Vz- We denote the set of r element subsets 
of n by P{n,r). For / = {ii, . . . , v} C n with ii ^ ^2 ^ • • • ^ V we define 

:= fjj A • • • A Vi^ and if / C m, then we define z{I) = v^i^ A A • • • A f A Vi^. 
Recall that an element of the exterior algebra whose odd degree components are 

is central. For r G {0, . . . ,m}, we define Zr = Yl,i(^p{mr) -^(-^) (-^0 = !)• Note 
that zi G /\^ Vi is the element corresponding to the symplectic form under the 
canonical isomorphism /\ Vi — /\ V£. As is well-known, the vi form a basis 
of A In /\ Vq we have Zr = (l/r!)z[. From this we deduce ZrZg = (J'^^^^Zr+s- 

The symplectic content of a tableau T is the tuple a G Z"^, such that a, 
is the number of occurrences of i and i' in T. We define the lexicographical 
order < on as follows: a<b ii a = b or a^b and < 6j, where 

1 = max{j G m I Oj ^ bj } and the maximum is taken according to ^ . For 
subsets / and J with symplectic contents a and b respectively, we write I < J 
if a < 6. 

Proposition 2.1 (cf. p] . [18] . [3T] ^ . 

(i) For every J G P{n, r) not symplectic standard, the vector vj ^ Vz can 
be written as 



{i e I\i or i ^ < C{j) 




(5) 
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with ajL,bjL G the first sum over all L € P{n,r) symplectic standard 
with L \> J and the second sum over all t G {1,..., [r/2j} and L € 
P{n, r — 2t) symplectic standard. Furthermore, all the L occurring have 
the same symplectic weight as J. 
(ii) The vectors zt A vj, t & {0, . . . , [r/2\}, J € P{n,r — 2t) symplectic stan- 
dard, form a basis of Vz- 

Proof, (i). Let J € P{n, r) be not symplectic standard. To prove the first asser- 
tion it suffices to show that vj can be written as in ([5]) with the first sum over 
ah L € P{n, r) with L t> J and the second sum over all t £ {1, . . . , [r/2j} and 
L G P{n,r — 2t), since then we can finish by induction on \ J\ and Now any 
element of the r*^ graded piece of the ideal of /\^ Vz generated hy z\, . . . ,Zm can 
be written as in the second sum. So what we need is precisely what is proved in 
|3H Lemma 8.1]. Let Piz be the maximal torus of diagonal matrices in Sp^^^. 
Then the final assertion follows by applying the projection onto the Plz x Hz 
weight space to which vj belongs to ([5]). 

(ii). By |23j Thm 17.5] Vq. is the direct sum of the irreducible Sp„(C) rep- 
resentations of highest weights rsi, (r — 2)ei, .... By [26] the dimension of the 
irreducible representation of highest weight (r — 2t)£i is equal to the number 
of symplectic standard J G P{n,r — 2t). So the assertion follows from (i) and 
the fact that the canonical map /\^ Vz /\^ Vc is an embedding, since /\^ Vz 
is free. □ 

For the comodule map A/\ : /\^ Vz ^ A*" ^z^'^[SpM^^j] of the SpM^^^-action 
we have 



where the sum is over all / G Pin, r). This just follows from the corresponding 
equations for the comodule map of the Mat„^z-action by restriction. Note that 
A/\ is a homomorphism of algebras, since M.&in,z acts on /\ by algebra endo- 
morphisms. We record now a result from [31]. For t = 1 the result follows from 
the relations As pointed out in [31] the result would follow immediately 
from the equality zt = (l/i!)z* in /\ Vq if we would know that Z[SpM„^g] has no 
torsion. This follows immediately from Theorem 12. H but to prove that theorem 
we need the result below. 

Lemma 2.1 ([31]). For each t G m, the element zt G /\^* Vz is a semi-invariant 
o/SpM^2 with weight d*, that is, A/s^{zt) = zt® d^ . 

Define the integers cli, I G P{n, r), L G P{n, r — 2t), by zt Av^ = clivj. 
Then we get the following corollary to Proposition 12.11 

Corollary 1. Let I,Jg P{n,r) with J not symplectic standard. Then we have 




(6) 



in Z[SpM„_2] 



{I\J) 



ajL{I I ^) + bj^LCL'id\L' I L) and 



(7) 



L t,L,L' 



iJ\I) 



ajL{L \I)+Y1 bj,LCL'id\L \ L') , 



(8) 



L t,L,L' 
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with ajL, hjL G Z given by ([5]); in both cases the first is sum over all L G P{n, r) 
symplectic standard with L \> J and the second sum is over all t £ {1, ... , [r/2j } 
and L, L' S P{n, r — 2t) symplectic standard. Furthermore, all the L and L' 
occurring have the same symplectic weight as J and I respectively. 

Proof. Equation ([7]) follows by applying the comodule map (0) to ([5]), using 
the fact that Aa is a homomorphism of algebras and using Proposition 12. II and 
the definition of the cl/. The automorphism Xij i->- Xji of Z[Matn,z] sends the 
bideterminant {S \ T) to {T\S). Furthermore, it leaves the ideal generated by 
the elements ^ stable, so it induces an automorphism ip of ^[SpM^g]. Note 
that it is important here that both the relations corresponding to the condition 
A^JA = d{A)J and those corresponding to the condition AJA^ = d{A)J occur 
in ^ . Equation ([8]) now follows by applying (/9 to ([7]) . Note that we could have 
obtained ([8]) directly by considering the right action of SpM„ ^ on /\Vz. Let 
Hz be the maximal torus of diagonal matrices in Sp„ z- Then the final assertion 
follows by applying the projections onto the Hz x Hz weight spaces to which 
(I I J) and (J 1 1) belong to ([7]) and dH) respectively. □ 

Remarks 2.1. 

1. If r > m, then no L € P{n, r) can be symplectic standard. So for r > m and 
J S P{n,r) the first sums in ^ and ([8]) are zero. 

2. Let L O n and t G {1, . . . , [r/2j}. Then zt A is a signed sum of vj with 
in/' / (/' := {i'\ie I}), so CLi = for all / C n with In/' = 0. So for such 
/ the second sums in ([7]) and dS]) are zero. Note that this applies when / Cm. 

3. Let be the ideal of G A generated by zi, Zm- As pointed out in 
the proof of the above corollary one needs to prove straightening in G /\ Vz/N, 
since then one can prove it in general by induction on the degree. The relations 
that are used for this are 

JGP(m,r),JnI=<l) 

for all / G P{m,r). See |3H (19)] or [18', 2.2]. If we now multiply both sides 
with vl, for each L C. n such that /H (LUL') = 0, then we may restrict the sum 
to all J G P{m, r) such that Jfl (/ULUL') = and applying the comodule map 
we obtain explicit relations that can be used for the symplectic straightening. 
See condition (iv) on page 119 in [18] and also [8, Prop. 1.8]. 

For the proof of Theorem 12.11 we need the following simple lemma. 

Lemma 2.2. Let N be a finitely generated Z-module and let xi, . . . ,Xr be gen- 
erators of N . If, for some field ¥ of characteristic 0, dimF ^z N > r, then 
(xi, . . . ,Xr) is a basis of N (and, of course, dimF ^z N = r). 

Proof. Assume that N has torsion. Then we have for some prime p that 
dimFp ®z N > ikN = dimF 0z N > r, where Fp denotes the field with p 
elements. This contradicts the fact that (1 (8) xi , . . . , 1 ® x^) generates Fp (g)^ 
So the canonical map N ^ ¥ ®z N is an embedding. Since (xi, . . . , Xr) gener- 
ates F (^z it must be a basis of F (^z N and therefore also be independent in 
N. □ 
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Theorem 2.1 (cf. [31, Thm. 6.1]). Recall that the type Cm partial order on 
weights is denoted by <. 

(i) Let X be a partition of length < m and let S and T be tableaux of shape 
A. Then the bideterminant (S \T) G ^[SpM^^g] can be written as a lin- 
ear combination ^^^Oid^' {Si \ Ti), where the Oj are integers and (5j,Tj) is 
symplectic standard of shape /ij < A with \^i \ = |A| — 2tj and with the same 
symplectic weight as {S, T) . 

(ii) The elements d*(S'|T) with t an integer > and S and T symplectic 
standard form a basis ofZ[SpM^^]. 

Proof, (i). Note that for A,/i G Z™", we have that X <c„ fJ- implies A < (< is 
—Cm)- So it suffices to prove the result for A a partition of length < n and with 
the ordering < on weights replaced by <c,i- The point is that we will use GL„- 
straightening and there shapes of length > m may show up (of course a tableau 
with such a shape can never be symplectic standard). First we show that, when 
5 and T are GL„-standard, but 5 or T is not symplectic standard, {S \ T) can 
be written as a Z-linear combination ai{Si | Tj) + hid^*\S[ \ T/), where in 
the first sum Si and Tj are of shape A and Si or Tj has symplectic content [> 
than that of S" or T respectively and in the second sum the tj are > 1 and the 
S[ and T[ are of shape /ij <c„ A with = |A| — 2tj. To prove this we apply ([7]) 
or ([8]) to the minor corresponding to the first columns of S and T, and all that 
remains to check is that the new shapes that arise from the second sums in ([7]) 
or ([8]) are <c„ A. Such a shape // is formed by shortening the length of the first 
column of A by an even number, 2t say, and moving the resulting column to the 
right position to get a Young diagram. So /i = A - ^■^Q(ei_2i + e«-i-2j) <c„ \ 
where / is the length of A. 

Now one can finish by induction. The argument via contradiction is as fol- 
lows. Give Z*^ X Z"^ the lexicographical ordering based on the ordering < of 
Z'^. Assume the assertion doesn't hold. Pick a counterexample with |A| min- 
imal and then with the pair of symplectic contents maximal with respect to 
the ordering we just defined. By Theorem ILlT i) and the fact that /x <a„_i ^ 
implies /i <Cn may assume that our bitableau is GL„-standard. Now 

what we proved above leads to a contradiction. 

(ii). Clearly, the piece of degree r of C[SpM„ j-] surjects onto that of C[GSp„(C)], 
where the bar denotes Zariski closure. By [371 Prop. l(i)] this is the dual space 
of the enveloping algebra E of Sp„(C) (or GSp„(C)) in Endc(F5f'' )■ By Weyl's 
complete reducibility theorem for complex semisimple Lie algebras E has di- 
mension dimL(A)^, where L{X) is the irreducible Sp„(C)-module of highest 
weight A and the sum is over all A such that L{X) appears in V^''. By [HUj 
VI.3](p.l75) these are the partitions of r,r — 2, .. .. Now dimL(A) is the num- 
ber of symplectic standard tableaux of shape A by [26j, so dim£' is the number 
of bitableaux {S,T) with 5 and T symplectic standard of degree r, r — 2, . . .. 
So, by (i) and LemmaE^l the elements d\S \ T) with t G {0, . . . , [r/2\} and S 
and T symplectic standard of degree r — 2t form a basis of the degree r piece 
ofZ[SpM„,^]. □ 
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By Theorem I2.ir ii) over K, d G i^[SpM„^] is not a zero divisor. Therefore 
K[SpM„^j^] C K[SpM„^^][d-i] = K[GSp2k)] is a domain. So SpM„ ;^ is 
reduced and SpM^{K) is an irreducible closed subvariety of Mat„(X) which 
is defined over the prime field. Since GSp„ is dense in GSp„(ii'), it is also 
dense in SpM„(K), so the canonical epimorphism A;[(SpM„)fc] A;[SpM„] is an 
isomorphism. This was deduced in a different way in [3H Cor. 6.2]. Note that 
the reducedness results above can be expressed by saying that fibers of SpM^ ^ 
over Spec(Z) are reduced. In case A; = is algebraically closed, we have that 
A;[SpM„] is a unique factorisation domain by [371 Prop. 2]. In particular, it is 
normal and therefore Cohen-Macaulay by 1331 Cor 2]. 

For A a partition of length < m we define ^<a, ^<a5 V(A), V(A) C Zpp^g] 
completely analogous to the Mat„^2-case. Note that the automorphism of 
^[SPnz] given by ^ i— >• JA^J = A^'^ on Sp„ ^ maps V(A) and V(A) onto 
each other and defines an isomorphism between the two. 

Theorem 2.2. Let X be a partition of length < m. 

(i) Let S and T he tableaux of shape A. Then the hideterminant (SIT) € 
^[SPnz] he written as a linear combination Yli^ii^i where the 
Oi are integers and the (5j,Tj) are symplectic standard of shape < A with 
the same symplectic weight as {S,T). 

(ii) The bideterminants {S \T) with S and T symplectic standard form a basis 
o/Z[Sp„^z]- 

(iii) The elements {Tx |T), T symplectic standard of shape A form a basis of 
Vz(A) and the elements {T\Tx), T symplectic standard of shape A form 
a basis of Vz(A). 

(iv) The map {S \ Tx) {Tx \ T) (S \ T) defines an isomorphism 

Vz(A) ®z Vz{X) ^ A<x/A<x 
of SPn,i. X Spn^^-modules. 

Proof. We have Z[Sp„ 2] = Z[SpM„ 2]/(d — 1), so (i) and (ii) follow from The- 
orem [2TTJ 

(iii) . We first show that the given tableaux span Vz(A) and Vz(A). By Theo- 
rem (TTTJ^iii) we only have to show that a symplectic straightening step ([7]) or ([8]) 
applied to [Tx \ T) or (T | Tx), T not symplectic standard, of shape A, does not 
yield any new shapes. This follows from Remark 12.11 2. If we take ^ to be the 
natural order, then Tx is standard, so (ii) gives us then that Vz(A) and Vz(A) 
are free of rank equal to the number of symplectic standard tableaux of shape 
A. Since this number is independent of the linear order ^, this proves (iii). 

(iv) . The argument is precisely the same as in [9]. It suffices to show that the 
map is well-defined, since then it will map a basis to a basis. This follows from 
the fact that, once we factor out all bideterminants of shapes < A, straighten- 
ing steps for {S \ T) arising from S are valid for all T and vice versa. For the 
symplectic straightening steps this is expressed by the fact that the integers 
ajL in (0) and ([5]) do not depend on I. □ 

Let and be the Borel subgroups in Sp„ ^ corresponding to the posi- 
tive resp. negative roots. The notion of saturated set, the functor O^r and the 
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induced modules are defined completely analogous to the GL^^^-case in Sec- 
tion 1. The proof of the corollary below is also completely analogous to the 
Corollary to Theorem 11.11 so we omit it. Assertion (i) was proved in [18] over 
K in another way. 

Corollary. 

(i) Let A G A+(m). Then Vz(A) is the induced module ind^'^'^(A) and V2(A) 

is the induced module of the B^-module —X, according to |25j . 

(ii) Let IT C A"^(m) be saturated. Then 0^(Z[Sp„2]) spanned by the bide- 
terminants {S \ T) where S and T have shape € vr. Moreover, the {S \ T) 
with S and T symplectic standard of shape € vr form a basis. 

Remark 2.2. The main results in [8j are also valid for the symplectic standard 
tableaux of King that we used. First we note that if we take for < the order 
m^m'^----<2^2'-<l^l', see also [32], then a subset of n is symplectic 
standard in the sense of King with the ordering ^ if and only if it is admissible 
in the sense of [8j (with the natural ordering), see [M]. If is an affine 
scheme over R, M and N i?-modules and fi : x M — ?> a morphism such 
that •) : M{S) ^{S) is linear for all x € X{S) and all R algebras S. 
Then we get an i?-linear map A : M N R[Xfi] by the same recipe as 
in \25\ 1.2.8]. If M and N are i?-algebras and the maps ^(x,-) are algebra 
homomorphisms, then A is a homomorphism of algebras. There is of course 
also a version for a "right action". In the latter case we can take X to be the 
Z-scheme of 2r x m-matrices with totally singular column space from [8]. Then 
we can take M = ^Z^*" and = /\Z™. Next we show that the "action" /j 
kills the zt € A^^*^; t > 0. Then one applies the comodule map A to ([5]) and 
obtains the identities needed for the straightening and one obtains the spanning 
results for Kings standard tableaux. Next one proves independence over Z using 
Lemma 12.21 and the presence of highest weight vectors and finally one proves 
reducedness as in for k[M]/{d) in Proposition 13. iT i) in the next section. 



3. A BIDETERMINANT BASIS FOR A REDUCTIVE MONOID 

Let i? be a commutative ring. Let M{R) be the set of n x n matrices 



A 




with A,B e M&irn{R) and B = AB'^ = d{A, B)I for some scalar d{A, B) G 
R. Here denotes the transpose of a matrix A and / is the m x m identity 
matrix. Clearly M{R) is a submonoid of Matm(i?) x Ma.tm{R) C Mat„(i?). 
We denote the group of invertible elements of M[R) by G{R). Note that G{R) 

\A 



contains the group G{R) of matrices 



A G GLm(i?). We denote 



(yl-i)^ 

the functors R ^ M{R), R ^ G{R) and R ^ G{R) by Mg, Gz and Gz. 
The functors Mz and Gz are closed subschemes of Matm,,z x Matm,z and the 
functor Gz is a closed subscheme of GLm,z x GL^.z- From now on we will take 
J to be the second matrix in ([2]) and we write Z" = Vz ® Wz, where Vz is the 
sub Z-modules spanned by the natural basis elements Vi with i £ m and Wz 
is spanned by the elements Wi := Vi' , i G m. Then Mz is a closed submonoid 
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scheme of SpM^^^. Note furthermore that Vz and Wz are sub Matm,z x Mat^.z- 
modules and therefore also sub M^-modules of Z". For f,j € m, we define hij 
and hij to be the restrictions of giji and ^j^;, respectively, to Matm,z x Mat^^z- 
For i,j G m we denote the restriction of Xij to Mat^.z x Mat^^z again by Xij, 
but the restriction of Xiiji to Matm,z x Mat^.z will be denoted by yij. So we 
have for i^j g m 

m m 

/ijj = ^ x^y/j and hij = ^ Xjiyji . 
1=1 1=1 

The ideal of in 7j[Matm^z x Matm,z] is generated by the elements hij, 1 < 
i, j < m, i ^ j, and /i^-r — 1, 1 < r < m. The ideal of Gz in Z[GLm,z x GLm,z] is 
generated by the elements /ijj, 1 < i, j < m, i 7^ j, and hrr — hss, 1 < r, s < m. 
The ideal of Mz in Z[Matm,z x Matm,z] is generated by the elements 

{hij, hij, hrr - hss\l < i,j <m,i^j,l<r,s< m}. (9) 

The algebra Z[Matm,z x Matm,,z] is Z x Z-graded by deg{xij) = (1,0) and 
deg{yij) = (0, 1). The algebra Z[Mz] inherits a grading, since the ideal of Mz 
is generated by homogeneous elements. The restriction of the coefficient of 
dilation d G Z[SpM„ to Mz coincides (of course) with the function d € 'L\Mz\ 
defined above. Note that Gz — Ghrn,i- Precisely as in the case of GSp„ ^ in 
Section [2] one shows that the fibers of Gz over Spec(Z) are reduced. So G{K) 
is a closed subgroup of GL„(i^), defined over the prime field. Furthermore, it 
is connected and reductive, and each of its elements is a scalar multiple of an 
element in G{K). The group G = G{k) is the group of /c-points of G{K) and 
it is dense in G{K). It is our aim in this section to show that the functions ([9]) 
generate the vanishing ideal of M in /c[Matm x Mat^]. This will be deduced 
from a bitableaux basis result. 

The group scheme Gz has the maximal torus of diagonal matrices in common 
with Sp„2) we denote its character group hy X, it is isomorphic to Z™. We 
will use the same notation for the restriction of characters of diagonal matrices 
in GLn,z to those in Gz as in Section [2j Furthermore, we will again embed Z™ 
into Z"' by extending with zeros. We will now use the root system of Am-i 
and our choice of positive roots is the usual one: Si — Sj, 1 < i < j < m. The 
corresponding Borel subgroup of Gz is the subgroup of matrices of the form 
A Ol 

„ , with A upper triangular and B lower triangular. The type Am-i order 

U D 

or dominance order on weights and the set of (polynomial) dominant weights 
are defined as in Section [1] with n replaced by m. We denote the length of a 
partition A by /(A). 

We assume given a linear order < on m. Define C : m — )• m by 

C{j) = \{i^m\i< 

Note that i ^ j if and only if < C{j)- Let A"*^ and A^ be partitions of length 
< m. Following Stembridge [35] we define a rational tableau of shape (A^,A^) 
to be a pair T = (T^T^) where is a tableau of shape A* with entries in m . 
For j € m, we define the j*^ column of T to be the pair (C^,C^), where C* is 
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the j*^ column of T*. Of course or or both may be empty. A pair of 
subsets I = {1^,1'^) is called standard if 

\{iel'\i^j}\ + \{iel^\i^j}\<aj) 

for all j € m. We identify each pair of subsets / = (/^, P) of m with the one 
column rational tableau (T^, T^) such that, for i = 1,2 the entries of are the 
elements of P and the entries of T* are strictly increasing (according to ^) from 
top to bottom. A rational tableau is called standard if and are standard 
and if its first column is standard. If T is standard, then every column of T 
is standard. Note that if a rational tableau of shape (A^,A^) is standard, then 
l(Ai) + /(A^) < m. For A^, A^ G Z"^ we put 

where A^"^*^^ is the reversed tuple of A^. It is easy to see that for any A € 
there exists unique partitions A^ and A^ with /(A^) + Z(A^) < m and A = [A^, A^]. 
In the sequel, when A^ and A^ are introduce after A, they are supposed to have 
these properties. If A G and A = [A^,A^] as above, then we say that 
a rational tableau has shape A if it has shape (A^,A^). Let T = {T^,T'^) 
be a rational tableau of shape (A^,A^), then we define the weight ^ of T by 
H = fi^ — ij? , where is the weight of T* as defined in Section [1] (with n 
replaced by m). If the entries in each column of and are distinct, then 
we have -[\^,\^] = [X^A^Y"^ < ^ < [A\A2]. Now let A G A:+ and write 
A = [A^, A^] as above. Then we define the canonical rational tableau T\ as the 
rational tableau (T^,T^) of shape A such that has all its entries in the z*^ 
row equal to i, 1 < i < /(A^), and has all its entries in the i^^ row equal to 
m — i + l<i< l{y?). Note that Tx has weight A and that one can make it 
standard for the natural order by reversing each column of T^. 

Let A^ and A^ be partitions of length < m. A rational bitableau of shape 
(A^, A^) is a pair {S,T) where S and T are rational tableaux of shape (A^, A^), 
we call it standard if both S and T are standard. Now let {S, T), S = {S^, S'^), 
T = (r^,r^), be a rational bitableau of shape (A^,A^). Then we define the 
bideterminant {S \ T) associated to {S, T) by 

{S\T) = {S^\T^)i{S^\T% , 

where (5^ |^^)i is defined by ([T]) with S, T and A replaced by 5^, and A^ 
and (5^ | T^)2 is defined by ([1]) with Xjj, S, T and A replaced by yij, 5^, and 
A^. We define the weight of a rational bitableau (S*, T) to be (— /i, v) ^ X x X, 
where /i is the weight of S and v is the weight of T. If is the maximal torus 
of diagonal matrices of G^, then the bideterminant {S \ T) is an x weight 
vector with weight equal to that of {S,T). The degree of a rational tableau or 
bitableau of shape (A-^, A^) is defined to be (|A-^|, |A^|). Note that the degree of 
a bideterminant {S\T) is equal to that of the rational bitableau {S,T). The 
content of a rational tableau T = {T^,T'^) is the tuple a G Z™, such that Oj is 
the number of occurrences of i in and T^. 

We give the exterior algebra /\(yz © Wz) a Z x Z-grading by giving the 
elements Vi degree (1,0) and the elements Wi degree (0, 1). For I = {I^ , I^) G 
P{m,r) X P{m,s) we define vj := Vji A Wj2 G /\{Vz © WzY'^, where Vji and 
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Wj2 are defined as in Section [2] (for wj2 we use the Wi). Note tliat vj as defined 
here is equal to ±vji\j(^j2y as defined in Section [21 where (I^)' = {i' | i G I^}. 
In particular, the vj, I € P{m,r) x P{m,s), form a basis of /\{Vz © WzY'^- 
The elements z,. and the order ^ on Z*" is defined as in Section [2j We observe 
that if /, J G P{n,r) have the same degree (|/| = |J|) and the same symplectic 
weight, then |/nm| = |Jnm| and |/\m| = \ J\in\. It is now clear that one 
can reformulate Proposition 12. II with P{n, r) replaced by P{m, r) x P{m, s) and 
P{n,r — t) replaced by P{m,r — t) x P{m, s — t). The action of Matm,z x Matm,z 
on /\{Vz ® Wz) stabilises the Z x Z-grading and for the comodule map A/\ : 
MVz © WzY'' MVz © WzY'' (8 Z[Mz] of the M^-action we have 

A^{vj) = Y,vi(^{I\J), (10) 
/ 

where the sum is over all / G P(m, r) x P(m, s). This just follows by restriction 
from the corresponding equations for the comodule map of the Mat^.z x Mat^.z- 
action which in turn follows from our new definition of the vj and of the bide- 
terminants and from the fact that the comodule map is a homomorphism of 
algebras. Next we note that Lemma [2. II also holds for the M^-action, since 
is a closed subscheme of SpM„ Define the integers cli, I G P{m, r) x P(m, s), 
L G P{m, r — t)x P{m, s — t), by zt/\VL = Xl/ clivj. Now we obtain the follow- 
ing corollary of which the proof is completely analogous to that of Corollary 1 
to Proposition 12.11 To obtain ()12p from (jlip we use the automorphism which 
sends xij to Xji and yij to yji. 

Corollary 2 to Proposition 12. IL Let I,J^ P{m, r) x P{m, s) with J not 
standard. Then we have in 7j[Mz] 

(/ I J) = ^ ajL{I \L)+Y^ bj,LCL'id\L' \ L) and (11) 

L t,L,L' 

{J\I) = Y^ ajL{L \I)+Y. h,LCL'id\L I L'), (12) 

L t,L,L' 

with ajL,bjL G Z given by jS]); in both cases the first is sum over all L G 
P{m, r) X P{m, s) standard with L \> J and the second sum is over all t G 
{1, . . . , [r/2j } and L, L' G P{m, r — t) x P{m, s — t) standard. Furthermore, all 
the L and L' occurring have the same weight as J and I respectively. 

Remarks 3.1. 1. In our new labeling for the standard basis elements of /\Z"' 
one can formulate a stronger version of Proposition 12 . 1 1 and the above corollary. 
This is based on [10\ Cor 1.2, Prop. 1.3]. Instead of using the identity of 
Remark 12.11 3 one uses the identity 

z{L) = (modiV) 

L£P{m,r),LnK=Q 

for K Q m with \K\ < r. This is done as follows. Define the ordering ^ on 
P{m, r) by / = {ii -< • • • ^ i,.} ^ {ii ^ • • • ^ js} = J if r > s and it ^ jt for all 
t G {1, . . . , s}. This is equivalent to Viil) > i^i{J) for all i G m, where Uiil) = 
\{j ^ I\j ^ ^}|- See e.g. [35]. Now assume / = {1^,1'^) G P{m,r) x P{m,s) 
is not standard. Pick i minimal with i'i{I^) + i^i{l'^) > i- Then i G fl 
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and Vi^i{I^) + = z - 1, i.e. = m/_i((/2)^), where {I'^ f is the 

complement of inTTJ.. Now put J = /^n/^n[l,i] and = (/^)'^n(/^)'=n [1, z), 
where we use the standard interval notation (for our ordering < on m). Then 
Jn iiT = and one easily deduces that r := | J| = \K\ + 1. Now vi = ±vi'z{J), 
where /' = (/^ \J,P\J), so we can apply the above identity to the factor z{J) 
of vj. Then we may restrict the summation to those L that are also disjoint 
from I^\J and P\J, i.e. to those L that are subsets of JU [{I^UPyr){i, oo)) . 
The final result is that Proposition 12.11 with the new labelling and the above 
corollary also hold if we replace "L > J" by "L^ >- and >- J^". 
2. Assume k = K = C and let Ar^s ^ be the set of weights [A-*^, A^] where A^ 
and A^ are partitions with 1{X^) + ^(A^) < m, |A^| < r, |A^| < s and r — |A^| = 
s-\X^\. Then one easily checks that these are the dominant weights of the GL„- 
module V^'^ (V*)^^ . Now one can show that each of these weights is actually 
the weight of a highest weight vector. Using the fact that y contains the 
trivial module one is reduced to the case that r — |A^| = s — |A^|=0 and then 
one can simply tensor two highest weight vectors together. This is standard, 
see e.g. [SS] and [IJ, where also multiplicity questions are considered. As is 
well known, the dominant weights of the irreducible GL„-module with highest 
weight A are the dominant weights < A, so it follows from the above remarks 
that Ar^s is saturated. 

To prove the Theorem 13. II we need the following notation. For X,fJ.(z Z"^ we 
write n<i Xif Y^l^i m < Yli=i Aj for ah j G m. 

Lemma 3.1. Let fJ-^jfJ."^ € have entries > 0, let X^ and X^ be partitions with 
1{X^) + ^(A^) < m and assume that /i* <i A* for i = 1,2 and that \X^ \ — = 
|A2| - |/i2|. Then n^] < [X\X'^]. 

Proof. Put t = \X^\-\fi^\ = |A2|-|/i2| and, for i = 1,2, /j = /(A*), z^' = X'-tei^. 
Then we have for i = 1,2, ^u* <i z/* and = so < z/*. Now rj i— )• rj^^^ 
reverses the order < (but not <i) and r] i— )• — r/ also reverses this order, so 
< But [u\v^] = [X\X^]-t{ei, -e^_i,+i) < [X\X% since 

{ejY^^ = em-j+i and li < m — I2 + 1- □ 

Theorem 3.1. Recall that the type Am-i partial order on weights is denoted 
by <■ 

(i) Let X G be a dominant weight and let S and T be rational tableaux 
of shape X. Then the bideterminant {S\T) G ^[M^] can be written as a 
linear combination - aid*' (Si |Tj), where the Oj are integers and {Si,Ti) 
is standard of shape fii < X with {{fijl, = (lA"*^!, [A^D — {ti,ti) and with 
the same weight as {S,T). 

(ii) The elements d*{S \ T) with t an integer > and S and T standard form 
a basis of Z[Mz]- 

Proof, (i). By Lemma l3.ll it is enough to prove that for A^ and A^ partitions 
of length < m and S and T rational tableaux of shape {X^,X'^) the bide- 
terminant (S\T) can be written as aj(i*'(5j | Tj), where the Oj are inte- 
gers and {Si,Ti) is standard of shape with n\ <i A^, //? <i A^ and 
(lyLtJl, l/Li^l) = (lA"*^!, lA^I) — (ti,ti). First we show that, when both parts of S 
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and T are GLm-standard, but 5" or T is not standard, (5 | T) can be written as 
a Z-linear combination J2i o-iiSi | li) + bid^^{Sl \ T[), where in the first sum 
Si and Tj are of shape (A^,A^) and Si or Tj has content [> than that of S or 
T respectively and in the second sum the tj are > 1 and the S[ and T[ are of 
shape with ^] <i AS /if <i A^ and {\^]\, = {\\\ \\^\) - {ti,ti). 

To prove this we apply (fTT]l or (fT2]) to the product of two minors corresponding 
to the first columns of S and T, and all that remains to check is that for the 
new shapes {11^,11^) that arise from the second sums in (fTT]l or (fT2]) we have 
/i^ <i A^, /i^ <i A^ and lA"*^! — |/i^| = |A^| — This follows easily from the 
fact that such a shape is formed by shortening the length of the first columns 
of A^ and A'^ by the same number and moving the resulting columns to the right 
positions to get a pair of Young diagrams. Now we can finish by induction as in 
the proof of Theorem I2.1l fi) applying the GLm-straightening separately to the 
two bitableaux of a rational bitableau. 

(ii) . We proceed as in the proof of Theorem 12. If ii). The piece of degree (r, s) of 
C[Mc] surjects onto that of C[G(C)]. By Proposition 11.11 this is the dual space 
of the enveloping algebra E of G(C) (or (5(C)) in Endc(Fc®'' ® W®'). Clearly, 
E is also the enveloping algebra of GL^(C) in ^udc{V®'' ® {V^)®'). By Weyl's 
complete reducibility theorem for complex semisimple Lie algebras E has di- 
mension dim L{Xf' , where L{\) is the irreducible GLm(C)-module of highest 
weight A and the sum is over all A such that L{\) appears in V^^ (8) (V'j?)®*. 
By Remark 13.11 2 these are the weights in A^^.;. Now dimL(A) is the number of 
standard rational tableaux of shape A by |35l Prop. 2.4(a)], so dimS is the num- 
ber of rational bitableaux {S,T) with S and T standard with shape G A^^^, i.e. 
with degree (r — t, s — t), t G {0, . . . , min(r, s)}. So, by (i) and Lemma [2^21 the 
elements d^{S \ T) with t G {0, . . . , min(r, s)} and S and T standard of degree 
{r — t, s — t) form a basis of the degree (r, s) piece of Z[Mz]. □ 

The arguments for the proof of the corollary below are precisely the same as 
in the case of SpM^^. See the paragraph after the proof of Theorem 12.11 

Corollary. 

(i) The fibers of over Spec(Z) are reduced and irreducible. 

(ii) The group G is dense in M{K) and the functions ([9]) generate the van- 
ishing ideal of M in A;[Matm x Matm]. 

Using the isomorphism Gz — GLm,z we can consider the Xij and Uij and the 
bideterminants as functions on GL^.z- For A G one defines A<x, A^x, Vz(A), 
Vz(A) C Z[GLm,z] completely analogous to the Mat„^z-case. Simply replace 
tableaux by rational tableaux. 

Theorem 3.2. The analogue of Theorems \l.l\ and \2.S\ holds for GLm,z x GLm,z 
acting on Z[Ghm^z], arbitrary dominant weights and rational bitableaux. 

Proof Since Z[Mz]/id-l) ^ Gz = GLm,z (i) and (ii) follow from TheoremEll 

(iii) . First we show that the given tableaux span Vz(A) and Vz(A). This is 
done precisely as in the proof of Theorem 12.2^ 111) using the fact that a column 
/ = (/^,/^) of Tx always has the property that PI = 0; for such I the 
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second sums in and (|12p are zero. To show independence we use the trick 

of Remark 11.11 1 : multiplying on the left or on the right with a matrix ^ p 

P a permutation matrix, we see that (ii) also holds if we use two orderings, 
for the left tableau and ^2 for the right tableau. In case of Vz(A) we can choose 
^1 such that Tx is standard (since 1{X^) + '(A^) < m) and in case of Vz(A) we 
can choose ^2 such that T\ is standard. Then (ii) gives us independence, 
(iv). This is proved precisely as in Theorem 12 . 2l f iv) . □ 

Now let Bz and be the Borel subgroups of upper resp. lower triangular 
matrices in GLm,z- Then the analogue of the corollary to Theorem 11.11 holds, 
its proof is also completely analogous. 

Corollary. The analogue of the corollaries to Theorems \l.l\ and \2.2\ holds for 
GLm,z X Ghm^z acting on 7j[GLm^z], arbitrary dominant weights and rational 
hitahleaux. 

Combining restriction of functions with the isomorphism Gk — (GLm)fc we 
obtain from Theorem 13.11 and the above corollary a canonical isomorphism 
Oa^^ (A:[GLm]) = k[MY'^ of coalgebras and therefore, by Proposition ll.llf i). a 
canonical coalgebra isomorphism of 0\^^ {k[GLm]) with the dual of the envelop- 
ing algebra of GL^ in Endfc(y®'' (F*)®^). This enveloping algebra is called 
the rational Schur algebra, see |13j and [19]. Prom the above remarks it is clear 
that the rational Schur algebra is a generalised Schur algebra, see [25, A. 16], 
and therefore quasihereditary. 

In the remainder of this section we assume that k = K is algebraically closed. 

\a 0' 

Por convenience, we will denote a matrix 



B 



e Maim X Maim by {A,B). 



Let X be the variety of noninvertible elements in M. Clearly, X is the set of 
zeros of d in M, so it consists of the matrices {A, B) where A,B£ Matm are such 
that A'^B = AB'^ = 0. Por r G m we define the idempotents Ey, , G Mat^ 
to be the diagonal matrices of which the first resp. last r diagonal entries are 
equal to 1 and all other diagonal entries are 0. Let r, s G m with r + s < m. We 
define Er^s G M by Er^s = {Er, Eg) and we define Xrs C X to be the variety of 
matrices {A,B) G M for which rk^ < r and rkB < s. Here rk^ denotes the 
rank of a matrix A. Note that the G x G-orbit of an idempotent Er^s is equal 
to its G X G-orbit. We have -'^ri.si ^ Xr2,s2 if and only if ri < r2 and si < S2- 
We let GLm x GL^ act on M using the isomorphism GL^ — G. Let U 
and U~ be the subgroups of GL^ that consist of, respectively, the upper and 
lower unitriangular matrices and let A G X~^. Recall that, by the corollary to 
Theorem 13.21 the bideterminants {Tx \ S) are [/"-fixed under the left regular 
action and that the {S \ Tx) and are [/-fixed under the right regular action. Of 
course, this also holds when we interpret the bideterminants as functions on 
M. It is a simple exercise in linear algebra to show that every element of X is 
GLm X GLm-conjugate to one of the idempotents Er^s- The variety Xrs is the 
closure of the GL^ x GLm-orbit of Ers and a simple centraliser computation 
shows that the dimension of X^s is — (m — [r + s))^ = {r + s){2m — {r + s)). 
The varieties X^^-r, < r < m, are the irreducible components of X. We 
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define Irs to be the ideal of k[X] generated by the minors in the Xij of degree 
r + 1 together with the minors in the yij of degree s + 1. 

Proposition 3.1. 

(i) The element d generates the vanishing ideal of X in k[M] and the hideter- 
minants {S \ T) with S and T standard form a basis ofk[X]. Furthermore, 
M is normal and X and M are Cohen-Macaulay. 

(ii) The ideal Ir^s is the vanishing ideal of X^s in k[X] and the bideterminants 
{S I T) with S and T standard form a basis of k[X] and those whose shape 
(A^, A^) satisfies 1{X^) < r and /(A^) < s form a basis of k[Xr^s]- 

(iii) ([65\ . [25] ] The varieties Xrs are normal and Cohen-Macauley and have a 
rational desingularisation. 

Proof, (i). One can define the GL^ modules A<x, A^x,V{X) and V(A) inside 
k[M]/{d) and Theorem 13.21 is then also valid for k[M]/(d). Moreover, V(A) 
and V(A) can be defined inside k[M] and then Theorem I3.2l fiii) is still valid. 
It now follows that the natural maps k[M] — ;> /i;[GLm] and k[M] k[M]/{d) 
restrict to isomorphisms between the different versions of V(A) and V(A). So, 
by the corollary to Theorem 13.21 the versions of these modules inside k[M]/(d) 
are induced modules. Now we have by [25, 11.2.13,11.4.13] for A,/i G X'^ that 



Clearly, {T\ \ T\) is a weight vector of weight (—A, A) and it is ?7 x U-Rxed. 
So the vectors (Ta | Ta), A e X+ form a basis of {k[M]/{d))'^~ , each with a 
distinct weight. So if a x i?-submodule of k[M]/{d) is nonzero, then it must 
contain one of these vectors. In particular this applies to the radical of the 
algebra k[M]/(d). However, (Ta | Ta) is nonzero as a function on X, since it is 
nonzero on Er^s, where r = |A^ |, s = |A^|, A = [A-*^, A^]. So k[M]/{d) is reduced 
and d generates the vanishing ideal of X in A;[M]. The second assertion is now 
also clear. We now show that M is normal. Since fc[M][(i~^] = k[G] is integrally 
closed, we only have to show that k[M] is integrally closed in A;[M][d~^]. So, 
let / G k[M][d-^] be integral over k[M]. Write / = /i/d'', with /i G k[M] such 
that d \ fi and assume that r > 1. Now / satisfies some monic equation, of 
degree s say, with coefficients in A;[M]. Multiplying through with d^^ we get 
that d\ff. Since, by (ii), the ideal (d) is radical, this implies that d\fi. This 
contradicts our choice of /i, so r = and / = /i G fc[-/Vf]. Now M is Cohen- 
Macaulay by [331 Cor 2] or (SJ Cor. 6.2.9] and X is then also Cohen-Macaulay, 
since k[X] = k[M]/{d). 

(ii). We first work over Z. Clearly, Z[X]/Irs^z is spanned by the given bide- 
terminants. Then we deduce from Lemma 12.21 and the presence of the highest 
weight vectors (Ta | Ta) that they must form a basis. This holds then also over 
k by base change and we can show that k[X]/Irs is reduced as in the case of 



(iii). All assertions are proved in [29] using Probenius splitting and Schubert 

varieties (one has to use the isomorphism {A,B) i— )• (A^jB) between X and 
the variety in [29j or [36j). The first two assertions are proved in [36] using 




k[X]/{d) in (ii). 
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Hodge algebras (see e.g. [6l Ch. 7] for a definition). The problem is however 
that the partial order on the minors given there does not satisfy axiom (H2), 
see Remark l3.2l l. We indicate how one can repair this using Grobner bases. In 
the polynomial algebra on the minors on the first and second matrix of size < r 
and < s respectively, consider the ideal generated by the GLm-straightening 
relations for the minors on both matrices separately (the minors in Irs are 
understood to be zero) and by the relations (fTT|) . (fT^ (note that in these equa- 
tions a symbol (/ 1 J) denotes a product of two minors and that the second 
sums are now zero). Now we order the minors according to the ordering ^ 
from Remark 12.11 1. keeping minors on different matrices incomparable. Then 
we extend this order to a linear order. Now we choose the reverse lexicographic 
order based on this order of the variables as our monomial order. Then the 
above relations form a Grobner basis. This follows from Remark 13.11 1. |30l 
Thm. 14.6] and the fact that if a term on the RHS of a GLm-straightening rela- 
tion does not satisfy (H2) for our order ^, then it must be a single minor. The 
latter follows from [9, Lemma 2.2], since the homogeneous coordinate ring of 
the Grassmannian is also a Hodge algebra for the opposite of the usual order on 
the minors. Now we grade the algebra by the size of the minors and we apply 
[301 Cor. 8.31] and deduce that A;[Xrs] is Cohen-Macauley, since this holds by 
Prop. 2.6] for the discrete algebra. Normality can now also be deduced as 
in [36]. □ 

Remarks 3.2. 1. The notion of standardness in [TU] and is equivalent to 
ours. In [36j Def. 2.4] the ordering of the minors is such that on the minors of the 
second matrix it is the reverse of the usual one. However, with this order k[X] is 
not a Hodge algebra. This can already be seen by taking m = 2 and considering 
the straightening relation yi2y2i = yiiy22— det. Then det < yi2, 2/21 in the usual 
order, so it cannot also have this property for the opposite order. In [lOj a partial 
order on the minors for which (H2) should hold is not clearly specified; one 
can repair things in the same way as in the proof of Proposition 13.11 Finally, 
we note that the minors in [9^ HI. 16] do not form a basis. The notion of 
standardness there amounts to the following alternative definition of rational 
standard tableau: A tableau {S^ | S"^) is standard if and 5^ are standard in 
the usual way and for each column of and each column of S'^ one 
has C in the ordering on sets based on the opposite ordering of the 
natural ordering of m. With this notion of standardness we get, with m = 4, 9 
standard rational tableaux of shape ((2, 1), (2, 1)) and weight (1,0,0, —1), but 
there should only be 5. 

2. Clearly the element d € k[M] is irreducible if m > 2, so k[M] is not a unique 
factorisation domain if m > 2. 

3. Similar bideterminants as the ones in this section have been considered in 
[14j . It is not clear to me whether the statements in this section about the new 
shapes that show up during straightening hold in the quantum setting. In view 
of [32] it seems plausible that there exists a quantum version of our monoid 
M whose coordinate ring (that is of course the real quantum monoid) has a 
bideterminant basis involving powers of a quantum coefficient of dilation. This 
should give an alternative proof of the double centraliser theorem in |14] . 
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4. The double centraliser theorem for the rational Schur 

ALGEBRA AND THE WALLED BrAUER ALGEBRA 

Let r,s be integers > 0. For any 6 £ k one has the Brauer algebra Br+si^) 
over k, see [1] or one of the many papers in the hterature on Brauer algebras. 
This also makes sense for 6 an integer, since we can replace that integer by its 
natural image in k. A walled Brauer diagram is a Brauer diagram in which the 
vertical edges join one of the first r vertices in the top row with one of the first 
r vertices in the bottom row or one of one of the last s vertices in the top row 
with one of the last s vertices in the bottom row, and in each row the horizontal 
edges join one of the first r vertices with one of the last s vertices. So if we 
draw a wall after the first r vertices in both rows as follows 



r vertices 



s vertices 



then the horizontal edges must cross the wall and the vertical edges must stay 
on one side of the wall. The walled Brauer algebra B^^si^), see [1] or [7j, is 
defined as the span in Br+si^) of the walled Brauer diagrams. It is a simple 
matter to check that this is indeed a subalgebra of Br+si^)- 

The standard basis of V = k"^ determines standard bases of y®*" and of 
V^^ <SiV®^ . We denote the entry of index ((ii, . . . , v), (ji, • • • , jV)) of the matrix 
of the endomorphism of V^^ given hy A G Mat^ with respect to the standard 
basis by aix---ir,jvjr- Then the entry of index 

(((Zl, . . . , v), {Ul, . . .,Us)), ((jl, . . . ,Jr), (Wi, . . .,Vs))) 

of the matrix of the endomorphism of V®"^ ® V^^ given by {A, B) G Matm x 
Matm with respect to the standard basis equals 

o^ii ■ ■ -ir - ■ -jr^ui ■ ■ -Us ,vi ■ ■ -Vs • Here 
A acts on the first r tensor factors and B acts on the last s tensor factors. 
When we consider V^^' V^^ as a GL^-module via the embedding GL^ ^ 
M C Maim X Matm given in Section El then we write 1/®'" (g) (V*)^" instead of 



Proposition 4.1. The enveloping algebra o/ GL^ in Endk{V®^ (^V*)^'"^) is, 
within the enveloping algebra o/ GL^ x GLm, defined by the equations 

m m 

(=1 1=1 

for ii,.. .,ir,Ui, . . .,Ur,jl, . . . ,js,Vl,. . . ,Vs G m. 

Proof. By (i) of the corollary to Theorem 13. II we have that the elements ([9]), i.e. 
the elements Si^uhjv — Sj,vhiu, generate the vanishing ideal of M in A;[Matm x 
Matm]. Now the corollary to Proposition 11.11 gives the assertion, since the equa- 
tion ()13p corresponds under the isomorphism rj from the corollary to the element 
Sh,uihjivi - ^h,vMiui multiplied by the monomial Xi^j^ ■ ■ ■ Xi^j^yu2V2 ■ ■ ■ Uusv,- 

□ 
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Now we fix r + s vector symbols xi, . . . ,Xr-\-s and r + s covector symbols 
yi, . . . , yr+s ■ We consider yi as the i^^ component function Xi as the r + s + i^^ 
component function on 0'""'''* V* © 0^"''* V. We put (/, x) = {x, f) = f{x) for 
/ G y* and x & V. With a walled Brauer diagram we associate a 2(r + s)- 
multilinear function F{D) on 0''"*"* V* ® 0'"''''* V as follows. We label the 
vertices in the top row from left to right with yi, . . . , yr,Xr+i, ■ ■ ■ , Xr+s and the 
vertices in the bottom row from left to right with xi, . . . , Xr,yr+i, ■ ■ ■ , Vr+s- For 
an edge e of we put (e) = {zi,Z2)., where zi and Z2 are the labels of the 
endpoints of e. Now we define F{D) = neeD(^)- 

We have GLm-equivariant isomorphisms 



that sends yi (X) • • • ® yr+s ® xi ■ ■ ■ ® Xr+s to 

{yi(^ ■ ■ ■ ®yr® Xr+l (8) • • • (8> Xr+s (8> (g) • • • (g) Xr <8) yr+1 • • • ® Vr+s) ■ 

Note that o y®{r+s)y identified with the vector space of 

2(r + s)-multilinear functions on 0^"'''* V* © 0^^^^ V . Under the above isomor- 
phisms, F{D) corresponds to an endomorphism E{D) G Endfc(y®^ (g (F*)*^*) 
and one can check that D E{D) is a representation of Br^sim). It is clear 
that the actions of Br^sim) and GL^ commute, since the multilinear functions 
F{D) are GLm-invariant. 

For the proof of Theorem 14.11 we need the diagram h G Br^sim) which is 
defined by 



The main result of the theorem below as the second assertion in (i). If k 
has characteristic zero this is a trivial consequence of the first assertion, the 
semisimplicity of the enveloping algebra of GL^ (by Weyl's theorem), and the 
fact that a semisimple subalgebra of a matrix algebra equals the centraliser of 
its centraliser. The theorem was first obtained in [14^ Thm. 6.11]. 

Theorem 4.1. The following holds. 

(i) The algebra EndcLml^'^'^ ^ (^V*)'^^) coincides with the image of Br^sim) 
in Endfc(F®'' © (V*)'^') and End^.^^m) (^®'' {V*)®') is the enveloping 
algebra o/GL„ in Endfc(y®'' © (V*)'^'). 

(ii) The homomorphism — >■ Endfc(y®'' © (V*)'^^) is injective if and 
only if m>r + s. 



Endfc(y®'^ © {V*)®') ^ 

{V®'' © {V*)®') © {V®'' © {V*)®y ^ 

{{{V*)®^ © V®') © {V®^ © {V*)®'))* ^ 



where the final isomorphism comes from the isomorphism 




I ::: I 



(14) 
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Proof, (i). The first assertion is proved precisely as in ^ using the first fun- 
damental theorem (FFT) of invariant theory |1H Thm. 3.1] for vectors and 
covectors. Since the group scheme {GLm)K is reduced and GL^ is dense in 
GLm{K), the GLm-invariants are the same as the formal invariants, i.e. the 
invariants of the group scheme (GLm)fc- The FFT gives us that the space of 
2(r + s)-multilinear GLm-invariant functions on V* © ©'^"'"^ V is spanned 

by the monomials in the {xi,yj) with the property that each Xi and each 
yj occurs exactly once. These are precisely the functions F{D). Therefore 
EndGL™(l^®^ ® {V*)®^) is spanned by the endomorphisms E{D). One can find 
similar arguments in [27]. 

Now we prove the second assertion. Since Br^si^) is generated by h and 
the diagrams corresponding to the permutations in Sym^ x Sym^ we have, by 
Proposition [TTTl^ii), that u G Endfc(y®^ ® (y*)®^) commutes with the action of 
Br^sifn) if and only if it occurs in the enveloping algebra of GL^ x GL^ and 
commutes with b. It is easy to check that commuting with h amounts to the 
equations ()13p . So the assertion follows from Proposition 14.11 
(ii). If m > r + s, then the second fundamental theorem [11| Thm. 3.4] gives us 
that the functions F(D), and therefore the endomorphisms E(D), are linearly 
independent, since the functions {xi,yj), 1 < i,j < r + s, are then algebraically 
independent. If m < r + s, then the equation det ((xj, yj)i<jj<r+s) = pro- 
duces a nontrivial linear relation between the F(D) and therefore also one 
between the E{D). □ 

Remark 4.1. Using Theorem 14 . 1 1 one can construct a "rational Schur functor", 
compare [20], and show, for example, that the walled Brauer algebra and the 
rational Schur algebra have the same block relation, compare [201 Thm. 5.5]. 
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